Web pages search engine based on DNS

Search engine is main access to the largest information source in this world, Internet. Now Internet is changing every aspect of our life. Information retrieval service may be its most important services. But for common user, internet search service is still far from our expectation, too many unrelated search results, old information, etc. To solve these problems, a new system, search engine based on DNS is proposed. The original idea, detailed content and implementation of this system all are introduced in this paper. 1 Introduction When designing a search engine we may meet two main bottleneck problems. Because the WWW is a large distributed and dynamic world, search engine can't continue to index close to the entire Web as it grows and changes. So we will meet some serious problems in coverage and recency. According to the statistical data in 1998[1], the update interval of most pages database is almost one month and no a search engine can cover more than 50 percentage pages on Internet. Till now, these data is still available. Although there was no any obvious improvement, there were surely some effective efforts for a better web pages search engine. Harvest [2] is a representative distributed information retrieval system. Based on Harvest, Cooperate Search Engine (CSE) [3] is developed. These two methods require each web site indexing their web documents and provide interface for search engines. These approaches will reduce the update interval and network traffic, but none of them is widely applied. This is mainly because not all administrators of sites will agree to index their pages for search engines. Reference [4] gave a practical idea to build a distributed search engine. In this paper, Author advised to share the databases of the search engine and introduced a layered architecture to improve the access to data on the Internet. But in this paper, the author didn't give an applied method on how to implement his idea. We develop our new search engine on the foundation of previous works. 2 The update of DNS The original idea of new system could be found in the history of WWW. When the DNS comes into being, there are only hundreds of web sites, so we can put DNS table in single server. When the number of sites reached level of million and scattered in different place, several DNS can't work efficiently. So DNS developed into a distributed hierarchical system. …